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Introduction 

This  paper  discusses  the  NIST  SQL  Database  Loader,  this  utility  takes  a STEP  file  and 
populates  SQL  tables  with  instances  of  STEP  entities.  This  document  is  intended  as  a 
programmer  and  user’s  guide.  After  reading  Translating  Express  to  SOL:  a User’s 
Guide,  users  may  skip  to  the  User’s  Manual  section  (section  5.0).  Programmers  should 
read  the  following  prerequisite  reading  materials  before  this  document:  The  NIST 
Working  Form  for  STEP.  The  NIST  STEP  Working  Form  Programmer’s  Reference, 
Translation  of  Express  Schema  into  SQL,  and  Translating  Express  to  SOL:  a User’s 
Guide.  In  addition,  objects  in  the  STEP  Working  Form  are  tightly  coupled  with  the  Ex- 
press Working  Form;  some  familiarity  with  the  latter  will  be  assumed  (see  Fed-X:  The 
NIST  Express  Translator  and  NIST  Express  Working  Form  Programmer’s  Reference). 

The  NIST  SQL  Database  Loader  is  implemented  in  ANSI  Standard  C [ANSI89b].  The 
Oracle  Pro*C  precompiler  is  used  to  embed  SQL  standard  queries  in  accordance  with 
the  ANSI  standard  for  Embedded  SQL  [ANSI89c]. 

Context 

The  Standard  for  the  Exchange  of  Product  Model  Data  (STEP)  is  an  emerging  standard 
for  the  interchange  of  product  data  between  various  vendors’  CAD/CAM  systems  and 
other  manufacturing-related  software.  A National  PDES  Testbed  has  been  established 
at  the  National  Institute  of  Standards  and  Technology  to  provide  testing  and  validation 
facilities  for  the  emerging  standard.  The  Testbed  is  funded  by  the  CALS  (Computer- 
aided  Acquisition  and  Logistic  Support)  program  of  the  Office  of  the  Secretary  of  De- 
fense. As  part  of  the  testing  effort,  NIST  is  charged  with  providing  a software  toolkit 
for  manipulating  STEP  data.  This  NIST  PDES  Toolkit  is  an  evolving,  research-oriented 
set  of  software  tools.  This  document  is  one  of  a set  of  reports  which  describe  various 
aspects  of  the  Toolkit.  An  overview  of  the  Toolkit  is  provided  in  An  Introduction  to  The 
NIST  PDES  Toolkit,  along  with  references  to  the  other  documents  in  the  set. 

For  further  information  on  the  NIST  SQL  Database  Loader  or  other  components  of  the 
Toolkit,  or  to  obtain  a copy  of  the  software,  use  the  attached  order  form. 

Architecture 

As  discussed  in  The  NIST  Working  Form  for  STEP.  STEPparse  consists  of  two  sepa- 
rate passes:  parsing  and  output  generation.  During  the  first  pass,  the  Express  file  is 
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parsed,  and  the  Express  Working  Form  is  created.  Using  the  Express  Working  Form, 
the  STEP  file  is  parsed,  and  an  instance  of  a Product  Data  Definition  is  built  in  the 
STEP  Working  Form.  The  second  pass  is  the  linking  of  the  output  module,  in  this  case, 
the  NIST  SQL  Database  Loader.  The  NIST  SQL  Database  Loader  can  be  dynamically 
or  statically  linked.  Once  linked,  the  NIST  SQL  Database  Loader,  following  through 
the  Product  Data  instance  in  the  STEP  Working  Form,  loads  the  Product  infor- 
mation into  the  appropriate  database  tables. 

2.1  Makefile 

The  makefile  used  by  the  NIST  SQL  Database  Loader  is  the  generic  makefile  used  by 
all  the  modules  that  form  the  Validation  Testing  System  Toolkit.  Hooks  for  the  Oracle 
Pro*C  precompiler  were  added. 

2.2  Database  Schema 

As  discussed  in  Translatine  Express  to  SOL:  a User’s  Guide,  an  Express  schema  is 
mapped  into  a relational  database  schema.  This  schema  creates  the  necessary  tables 
needed  by  each  entity  in  the  Express  schema  and  dictionary  tables  to  store  Express  se- 
mantic construct  information.  In  addition  to  the  above  dictionary  tables,  the  NIST  SQL 
Database  Loader  uses  a cross  referencing  table,  sys$entityid_tableid.  This  ta- 
ble consists  of  three  columns:  entity  id,  tableid,  and  fileid, representing 
the  STEP  file  entity  ID  of  an  object,  the  table  ID  of  an  object,  and  the  file  number 
the  entity  instance  is  in.  Figure  1 shows  an  example  STEP  file  objects  and  their  cor- 
responding entries  in  the  sys$entityid_tableid  table.  The  sys$entity- 
id_tableid  table  is  created  at  the  same  time  the  other  data  dictionary  tables  are 
created,  but  is  only  populated  by  the  NIST  SQL  Database  Loader. 
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STEP  file  objects. 

@ 1 =DIRECTION(„0.,0.,  1 .0000000308274466); 
@2=DIRECnON(„  1 .0000000308274466,0., 0.); 

@ 3=DIRECTION(„0.,  1 .0000000308274466,0.); 
@4=CARTESIAN_POINT(„0.20.428009033203 125,1 1.22300052 
64282227); 


Representation  of  table  SYS$ENTITYID_TABLEID  in  database. 
SYS  $ENTIT  YID_T  ABLEID 


ENTITYID 

TABLE  ID 

FILEID 

1 

DIRECTION ! 00000000 

NULL 

2 

DIRECTION ! 0000000 1 

NULL 

3 

DIRECTION ! 00000002 

NULL 

4 

CARTESLAN_POINT!00000003 

NULL 

Figure  1:  STEP  File  objects  & SYS$ENTTi'YID_T ABLEID  Table 


3 stepwf__sql  Internals 

The  NIST  SQL  Database  Loader’s  program  name  is  stepwf_sql.  As  with  other 
STEP  Working  Form  output  modules,  stepwf_sql  is  linked  to  STEPparse  via  an 
entry_point  function  with  the  following  parameters:  product  and  file,  corre- 
sponding to  an  instance  of  a Product  Data  Definition  in  the  STEP  Working  Form  and 
the  output  file  respectively.  Unlike  other  STEP  Working  Form  output  modules,  the  out- 
put file  is  not  used  as  input  data,  rather,  it  is  used  for  debugging  and  informational  pur- 
poses only. 

3.1  stepwf_sql  Flow  Control 

Moving  through  the  product  structure,  stepwf_sql  extracts  one  by  one  the  ob- 
jects contained  within  the  product  structure.  Each  new  object  signals  the  start 
of  a new  SQL  insert  statement.  If  the  object  is  sharable  by  other  objects,  an  entry 
is  made  into  the  sys$entityid_tableid  table.  The  attributes  of  the  object  are 
extracted,  and  each  attribute’s  type  is  checked. 

For  simple  ( Express  base)  type  attributes,  such  as  integers,  the  attribute’s  vs’ue  is  ap- 
pended to  the  current  object’s  dynamic  SQL  insert  statement. 

For  entity  type  attributes,  the  attribute  is  determined  to  be  either  embedded  or  not  em- 
bedded. For  non-embedded  entity  attributes,  a query  is  made  to  the  sys$entity- 
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id_tableid  table  for  the  table  ID  of  the  referenced  entity  ID;  the  table  ID  is 
appended  to  the  current  ob  j ect ’s  dynamic  SQL  insert  statement.  For  embedded  entity 
attributes,  a recursive  process  is  started  where  the  entity  attribute  is  treated  as  a new 

object. 

For  select  type  attributes,  the  value  is  retrieved,  then  its  type  is  tested.  If  the  value’s  type 
is  that  of  an  entity,  a recursive  process  is  started  treating  the  value  of  the  select  as  a new 
object.  Currently,  the  Express  to  SQL  mapping,  described  in  Translating  Express  to 
SOL:  a User’s  Guide,  states  that  if  the  type  of  the  value  of  the  select  is  not  entity,  then, 
the  value  is  represented  as  a string  and  appended  to  the  current  object’s  dynamic 
SQL  insert  statement. 

For  aggregate  type  attributes,  a new  dynamic  SQL  insert  statement  is  assembled  for 
each  element  of  the  aggregate.  If  the  element  of  the  aggregate  is  of  type  aggregate,  a 
recursive  approach  is  taken,  adding  on  subscripts  to  the  newly  created  dynamic  SQL 
insert  statement  until  a simple  element  is  found.  Figure  2 shows  an  example  of  the 
B_SPLINE_CURVE  aggregate  attribute  KNOTS. 


STEP  file  object:  B_SPLINE_CURVE.  The  KNOTS  attribute  is  highlighted. 

@370=B_SPLINE_CURVE(„4,8, 

(#310,#320,#325,#330,#340,#350,#360,#365,#368), 

.UNIFORM_KNOTS.,3,(5,4,5),r0.0,7.0^.0j, 

(1.0,1 .0, 1 .0, 1 .0, 1 .0, 1 .0, 1 .0, 1 .0, 1 .0)„.F.); 


B_SPLINE_CURVE  aggregate  attribute  KNOTS  table. 


B_SPLINE_CURVE#KNOTS 


ID 

SUBSCRIPTS 

VALUE 

B_SPLENE_CURVE!0000038 1 

0 

0.0 

B_S  PLINE_CURVE ! 000003 8 1 

1 

1.0 

B_SPLINE_CURVE! 0000038 1 

2 

2.0 

Figure  2:  Aggregates 

Once  a dynamic  SQL  statement  is  completely  assembled,  it  is  inserted  into  the  data- 
base; this  is  done  until  the  product  is  completely  loaded. 

3.2  Working  Form  Routines 

stepwf  sql  extracts  the  product  information  in  the  STEP  Working  Form  through  a 
series  of  STEP  Working  Form  access  functions;  these  are  listed  in  The  NIST  STEP 
Working  Form  Programmer’s  Reference.  In  addition,  access  functions  to  the  Express 
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Working  Form  are  also  used;  these  can  be  found  in  The  NIST  Express  Working  Form 
Programmer’s  Reference. 

3.3  Embedded  Pro*C 

The  NIST  SQL  Database  Loader  runs  interactively  with  the  Oracle  database,  using  em- 
bedded Pro*C  code.  Pro*C  code  is  used  throughout  stepwf_sql  to  connect  to  the 
user’s  database  account,  extract  dictionary  information,  and  of  course,  insert  the  part 
data.  Dynamic  SQL  is  used  to  insert  the  different  STEP  file  entities  of  the  part  into  their 
respective  tables. 

3.4  Table  ID  Assembly 

To  insure  that  each  table  ID  is  distinct,  the  following  method  for  creating  table  IDs  was 
devised.  Given  an  object’s  Express  entity  name,  the  EXPRESSYS  $NAMES  table  is 
queried  for  the  Oracle  entity  name.  An  exclamation  point  (!)  is  appended  to  the  Oracle 
entity  name,  and  finally  a number  is  appended.  This  number  is  generated  by  an  Oracle 
sequence,  TABLE_SEQ;  this  sequence  is  created  upon  database  schema  creation. 

3.5  Error  Checking 

Extensive  error  checking  is  included  in  stepwf_sql.  Since  the  Express  and  STEP 
parsers  are  executed  before  the  NIST  SQL  Database  Loader,  any  errors  and/or  warnings 
in  the  Express  and  STEP  files  should  be  flagged  before  reaching  this  software.  On  the 
other  hand,  there  may  be  errors  in  the  database.  For  this  reason,  stepwf_sql  will  re- 
port errors  it  finds  in  a descriptive  manner;  for  example,  if  there  is  no  table  in  the  data- 
base that  matches  the  object  to  be  inserted,  a rollback  of  the  database  is  executed, 
and  a descriptive  error  message  will  be  displayed  including  the  entity  ID  of  the  ob- 
ject where  execution  failed.  In  addition,  the  output  file  generated  lists  all  the  error 
free  inserts  made  into  the  database  before  rollback. 

4 Issues  of  Concern 

Currently,  stepwf_sql  has  the  ability  to  load  in  a partial  STEP  file,  then  at  a later 
point  in  time,  load  the  subsequent  data.  It  does  not  have  the  ability  to  load  more  than 
one  part  in  the  database.  In  order  to  load  multiple  parts  into  the  same  database,  the  issue 
of  how  to  differentiate  parts  needs  to  be  resolved.  At  the  present  time,  the  PS  CM  struc- 
tures would  have  to  be  populated  to  differentiate  parts;  there  is  nothing  explicit  in  the 
STEP  file  that  differentiates  parts. 

5 User’s  Manual 

This  section  deals  with  the  “how  to”  of  database  loading.  It  assumes  that  the  user  has 
already  created  a database  from  the  Express  schema;  look  at  the  Translating  Express  to 
SOL;  User’s  Guide  for  instructions. 
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5.1  Command  Line 

The  command  line  for  stepwf_sql  is  as  follows: 

% stepwf_sql  -e  express_schema .file  -s  step. file 
The  Express  schema  file  used  should  be  the  same  as  the  one  used  to  build  the  database 
schema,  and  the  STEP  file  to  be  loaded  should  match  the  schema  exactiy,  i.e.  all  at- 
tributes and  references  should  follow  the  structure  of  the  schema. 

First,  the  Express  file  is  parsed,  building  the  Express  Working  Form.  No  errors  of  det- 
rimental importance  to  the  database  schema  should  be  reported  at  this  time;  these 
should  have  been  dealt  with  at  schema  creation. 

Second,  the  STEP  file  is  parsed,  building  the  STEP  Working  Form.  Any  errors  should 
be  noted  with  great  care.  The  error  messages  from  the  STEP  parser  are  self-explanatory. 
If  error  messages  are  present  and  the  program  has  not  stopped  processing,  abort  the  pro- 
cess, and  fix  the  errors.  stepv/f_sql  will  have  to  be  restarted. 

If  no  error  messages  are  reported,  the  user  will  be  asked  for  their  account  user  name  and 
password.  They  will  also  be  asked  to  fill  in  an  output  file  name;  this  output  file  is  for 
informational  and  debugging  purposes  only.  Error  messages  after  this  point  indicate  a 
problem  with  the  user’s  database.  These  messages  are  also  straightforward,  for  ease  in 
debugging.  Once  the  errors  are  corrected,  stepwf_sql  will  need  to  be  restarted; 
stepwf_sql  rollbacks  the  database  to  the  state  prior  to  execution. 

5.2  Useful  Database  Utilities 

There  are  a number  of  useful  database  manipulation  utilities  available;  descriptions  of 
these  can  be  found  in  The  PDES  Testbed  User’s  Guide.  Of  these  utilities,  the  utility 
userdropdat  a drops  all  the  data  contained  in  a user’s  database.  As  mentioned  in  the 
above  “Issues  of  Concern”  section,  the  database  can  only  hold  one  part  at  a time.  Each 
time  the  user  wants  to  load  a new  STEP  file,  the  user  must  clear  the  database  using  the 
userdropdata  utility. 

6 Conclusion 

The  NIST  SQL  Database  Loader  takes  a STEP  file  and  Express  schema  as  input.  Ex- 
press schema  information  and  STEP  file  data  are  loaded  into  memory  working  forms. 
Data  is  retrieved  from  the  memory  resident  working  forms  and  used  to  populate  SQL 
tables  with  instances  of  STEP  entities. 

For  further  information  on  the  STEP  Working  Form,  the  database  schema,  or  other 
components  of  the  Toolkit,  or  to  obtain  a copy  of  the  software,  use  the  attached  order 
form. 
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